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Description t 

The present invention relates to an apparatus for 
decoding multiple moving picture signals and sound sig- 
nals, according to the preamble of claim 1 . 5 

Prior to giving a description with regard to the con- 
ventional multiple picture/sound signals decoding appa- 
ratus based on the MPEG system, a general encoding 
method and apparatus will be explained. 

To begin with, an interframe motion predicting meth- 10 
od in the MPEG system will be described below with ref- 
erence to Fig. 15. In this diagram, first a predictive-cod- 
ed frame P0 is predicted from an intra-coded frame 10. 
Subsequently a bidirectionally predictive-coded frame 
BO is predicted from the two frames 10 and P0. And sim- is 
ilarly another bidirectionally predictive-coded frames B1 
is predicted from the intracoded frame 10 and the pre- 
dictive-coded frame P0. For prediction of the bidirection- 
ally predictive-coded frames BO and B1, there are 
known three modes such as forward prediction from the 20 
predictive-coded frame P0, backward prediction from 
the intra-coded frame 10, and interpolate prediction ex- 
ecuted bidirectionally as mentioned above. And in prac- 
tice, the most adequate one for data compression is se- 
lected out of such three modes. 2s 

Hereinafter such intra-coded frame, forward predic- 
tive-coded frame and bidirectionally predictive-coded 
frame will be referred to as I frame, P frame and B frame, 
respectively. Now a description will be given on an ex- 
emplary apparatus for compression coding and decod- so 
ing signals of multiple moving pictures and sounds by 
the MPEG system. Fig. 16 is a block diagram of a mul- 
tiple picture/sound signals encoding apparatus which is 
capable of multiplexing and encoding three moving pic- 
tu res and th ree sounds. 35 

In Fig. 16, a digital moving picture signal V1 inputted 
to a terminal Ta is supplied via a compression encoder 
1 and a buffer 2 to a multiplexer 1 3. Meanwhile, moving 
picture signals V2 and V3 inputted to terminals Tb and 
Tc respectively are supplied via compression encoders 40 
3, 5 and buffers 4, 6 to the multiplexer 1 3. A sound signal 
A1 of the moving picture signal V1 is inputted to a ter- 
minal Td and then is supplied via a compression encod- 
er 7 and a buffer 8 to the multiplexer 1 3. Similarly, sound 
signals A2 and A3 are supplied via compression encod- 45 
ers 9, 11 and buffers 10, 12 to the multiplexer 13. 

Subsequently such signals are multiplexed by the 
multiplexer 1 3, whose output is then delivered via a buff- 
er 1 4 to a terminal Tg and is further supplied to a storage 
medium or a transmission line. Fig. 1 7 shows an exem- so 
plary data arrangement of the output signal obtained 
from the terminal Tg. The three moving picture signals 
and the three sound signals thus compression-coded 
are multiplexed in the direction of the time base, as 
shown in Fig. 17. Fig. 18 is a block diagram of the mov- ss 
ing picture compression encoder shown in Fig. 16. This 
encoder is of a general type equipped with a combina- 
tion of a DCT (discrete cosine transformer) and an in- 



terframe predictor. In Fig. 18, a moving picture signal a 
fed to a video input terminal T1 is stored in a frame mem- 
ory 21 and then is supplied to a subtracter 22 in the next 
stage. The output of the subtracter 22 is an interframe 
predictive difference signal which represents the differ- 
ence between the input picture signal supplied to the 
positive terminal of the subtracter 22 and the predictive 
picture signal supplied to the negative terminal thereof. 

The interframe predictive difference signal is sup- 
plied via a DCT 23 and a quantizer 24 to two transmis- 
sion lines. 

The signal from one transmission line is inputted to 
a variable length encoder 25 and then is multiplexed 
with motion vector data d and so forth in a multiplexer 
26, and the multiplexed signal is delivered as an encod- 
er output e from an output terminal T2 via a buffer 27. 
Meanwhile the signal from the other transmission line is 
processed in an inverse quantizer 28, an inverse DCT 
29 and an adder 30, and then is outputted as a decoded 
picture signal b. Subsequently the picture signal b is in- 
putted via a frame memory selector switch S W1 to frame 
memories 31 and 32. 

A motion vector calculator 33 generates a motion 
vector d on the basis of the input data obtained from the 
frame memories 21 , 31 and 32. 

A predictive picture generator 34 generates a pre- 
dictive picture signal c on the basis of both the motion 
vector data d obtained from the motion vector calculator 
33 and the picture signal stored in the frame memories 
31 and 32. 

The predictive picture signal c is supplied to the 
negative terminal of the subtracter 22 via a switch SW2 
while being supplied also to the adder 30 via a switch 
SW3. When the decoded picture signal b relative to the 
I and P frames, the switch SW1 is changed alternately 
so that local decoded picture signals of the I and P 
frames are supplied to the frame memories 31 and 32. 

The switches SW2 and SW3 are closed in the P and 
B frames where the motion is predicted, and a subtrac- 
tion and an addition for prediction of the picture are ex- 
ecuted in the subtracter 22 and the adder 30, respec- 
tively. The switches SW2 and SW3 are open in the I 
frame where the motion is not predicted, so that none 
of a subtraction and an addition for prediction of the pic- 
ture is executed in the subtracter 22 and the adder 30. 
Fig. 1 9 shows a conventional multiple picture/sound sig- 
nals decoding apparatus which is complementary to the 
multiple picture/sound signals encoding apparatus of 
Fig. 16. 

In Fig. 19, a multiplexed code obtained from a ter- 
minal Tg* is supplied via a buffer 35 to an inverse multi- 
plexer 36, where the multiplexed code is separated into 
three moving picture signals V1 , V2, V3 and three sound 
signals A1 , A2, A3. And such signals are supplied to re- 
spective decoders. The moving picture signal V1 is sup- 
plied via a buffer 37 to a decoder 38, and the decoded 
signal therefrom is supplied to a D-A converter 39 where 
digital-to-analog conversion is executed. And the ana- 
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log signal thus obtained is supplied to a display device 
40. Similarly the moving picture signals V2 and V3 are 
supplied via buffers 41 , 45 respectively to decoders 42, 
46 so as to be decoded. 

The sound signal A1 is supplied via a buffer 49 to a s 
decoder 50, and the decoded signal therefrom is further 
supplied via a D-A converter 51 to a reproducer 52. Sim- 
ilarly the sound signals A2 and A3 are processed in the 
same manner. Fig. 20 is a block diagram of the decoder 
38 (42, 46) shown in Fig. 1 9. A signal e fed to an input 
terminal T3 is supplied via a buffer 61 to an inverse mul- 
tiplexer 62, where the signal e is separated into the 
quantized moving picture signal and the motion vector 
data d. The compression-coded moving picture signal 
is decoded to an interframe predictive difference signal 
by a variable length decoder 63, an inverse quantizer 
64 and an inverse DCT 65, and then is supplied to an 
adder 66. The adder 66 receives, besides such differ- 
ence signal, a predictive picture signal inputted thereto 
via a switch SW5 from a predictive picture generator 69 
on the basis of the data obtained from the frame mem- 
ories 67 and 68, so that the two signals are added to 
each other to produce a decoded picture signal. 

The decoded picture signal thus obtained is stored 
in the frame memory 67 or 68 to become the data for 
producing a predictive picture signal while being input- 
ted to a frame selection switch 70. The switch SW4 is 
changed every time the I and P frames are decoded, 
and the switch SW5 is closed in the P and B frames 
where the motion is predicted. The switch SW5 is open 
in the I frame, so that the output of the predictive picture 
generator 69 is not added by the adder 66. 

In the frame selection switch 70, the decoded pic- 
tures are arranged in the display sequence and then are 
outputted to a terminal T4. 

In decoding and reproducing the compression-cod- 
ed signals of multiple moving pictures and sounds men- 
tioned above, it is necessary to prepare multiple decod- 
ers, D-A converters, display devices and reproducers 
equal in number to the moving pictures and the sounds, 
as shown in Fig. 1 9. Therefore, the apparatus is ren- 
dered great in both structure and scale to be conse- 
quently inadequate for general use in particular. 

From IEEE International Conference on Communi- 
cations ICC'90, volume 1, Atlanta, GA, OS, pages 134 
- 139; 15-19 April 1990, Weiss: "Desktop video confer- 
encing-An important feature of future visual communi- 
cations 0 an apparatus for decoding input signals such 
as multiple moving picture signals and sound signals 
read out from a recording medium or those received via 
transmission line, e.g. in a multipoint video conference 
system according to the preamble of claim 1 is known. 

SUMMARY OF THE INVENTION 

It is an object of the present invention to provide an 
improved multiple picture/sound signals decoding appa- 
ratus which is capable of simultaneously reproducing 



multiple moving pictures by a single display device and 
further reducing the scale of the apparatus constitution. 

According to the present invention, there is provid- 
ed an apparatus for decoding input signals inclusive of 
multiple compression-coded moving picture signals and 
sound signals read out from a recording medium and 
also signals received via transmission lines according 
to claim 1. Such apparatus comprises a decoding 
means for curtailing the input picture signals at a prede- 
termined interval to produce multiple picture signals re- 
duced both horizontally and vertically, and decoding 
each of such multiple picture signals; frame memories 
connected to the decoding means; a means for display- 
ing the multiple pictures on a single screen; and a means 
for controlling the operations of the decoding means and 
the display means. 

In this decoding apparatus, the decoding means 
comprises a means for separating motion vectors from 
the input signals; a means for generating the reduced 
multiple picture signals; a means for reducing the motion 
vectors in conformity with the reduction rate of the pic- 
ture signals; and a means for generating a predictive 
picture on the basis of the reduced picture signals and 
the reduced motion vectors. 

Further in the decoding apparatus, the control 
means is capable of selecting, in response to a mode 
selection signal, a multiple moving picture mode for dis- 
playing the reduced multiple moving pictures on a single 
screen of the display means, or a single moving picture 
mode for displaying merely one of the multiple moving 
pictures on the single display means. 

When the multiple moving picture mode is selected 
in such decoding apparatus of the present invention, the 
output of an inverse DCT is first reduced by means of a 
reducer both horizontally and vertically, and then is sup- 
plied to an adder. The number of frame memories re- 
quired for decoding P and B frames need not be equal 
to the number of the moving pictures, and one frame 
memory is divided into a plurality of memories which are 
used independently of one another. The decoded mov- 
ing pictures are supplied via display control means to a 
single display means where the moving pictures are dis- 
played simultaneously. Meanwhile in the single moving 
picture mode, reduction of the multiple moving pictures 
is not executed, and one of such multiple moving pic- 
tures is decoded by the conventional known method and 
then is displayed on the display means. 

The sound signals are switched in conformity with 
the selected mode. 

The above and other features and advantages of 
the present invention will become apparent from the fol- 
lowing description which will be given with reference to 
the illustrative accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of a first embodiment rep- 
resenting the multiple picture/sound signals decod- 
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ing apparatus of the present invention; 
Fig. 2 is a block diagram showing the details of a 
decoder employed in the apparatus of Fig. 1; 
Fig. 3 illustrates an exemplary display state on a dis- 
play screen in a multiple moving picture mode in the s 
apparatus of Fig. 1 ; 

Fig. 4 shows how the storage space in a frame 
memory is divided for use in the apparatus of Fig. 1 ; 
Fig. 5 illustrates an exemplary display state on a dis- 
play screen in a single moving picture mode in the 10 
apparatus of Fig. 1 ; 

Fig. 6 is a block diagram showing the details of a 
multiple sound signals decoder employed in the ap- 
paratus of Fig. 1 ; 

Fig. 7 is a block diagram of a second embodiment is 
representing the multiple picture/sound signals de- 
coding apparatus of the present invention; 
Fig. 8 is a connection diagram showing the details 
of a selector employed in the apparatus of Fig. 7; 
Fig. 9 illustrates another exemplary display state on 20 
a display screen in a multiple moving picture mode 
in the apparatus of Fig. 1 ; 
Fig. 10 is an explanatory diagram of an interframe 
motion predicting method based on the MPEG sys- 
tem; 25 
Fig. 1 1 shows the kinds and the sequence of frames 
of moving pictures encoded in an apparatus of Fig. 
16; 

Fig. 12 is an explanatory diagram showing the se- 
quence of frames decoded in the apparatus of Fig. 30 
1 and also the sequence of frames stored in the 
frame memory; 

Fig. 1 3 is another explanatory diagram showing the 
sequence of the frames decoded in the apparatus 
of Fig. 1 and also the sequence of frames stored in 35 
the frame memory; 

Fig. 1 4 is a further explanatory diagram showing the 
sequence of the frames decoded in the apparatus 
of Fig. 1 and also the sequence of frames stored in 
the frame memory; 40 
Fig. 1 5 shows the sequence of frames stored in the 
frame memory; 

Fig. 1 6 is a block diagram of a general multiple pic- 
ture/sound signals encoding apparatus; 
Fig. 1 7 shows an exemplary arrangement of coded *s 
data outputted from the multiple picture/sound sig- 
nals encoding apparatus of Figs. 16 and 18; 
Fig. 18 is a block diagram showing the details of a 
compression encoder employed in the apparatus of 
Fig. 16; so 
Fig. 1 9 is a block diagram of a conventional multiple 
picture/sound signals decoding apparatus; 
Fig. 20 is a block diagram showing the details of a 
decoder employed in the apparatus of Fig. 19; 
Fig. 21 illustrates how a picture signal is reduced to 55 
1/2 both horizontally and vertically; and 
Fig. 22 schematically shows pixels in one frame. 



DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

Hereinafter exemplary embodiments representing 
the multiple picture/sound signals decoding apparatus 
of the present invention will be described in detail with 
reference to the accompanying drawings. 

In the embodiments, the process of decoding mul- 
tiple moving picture signals signifies an operation of 
reading out multiple kinds of moving pictures from a re- 
cording medium (such as optical disk, magneto-optical 
disk, magnetic disk or any other storage medium) or 
from a transmission line and decoding the read signals, 
and further includes an operation of dividing one kind of 
successive moving pictures into multiple signals and de- 
coding such divided picture signals. 

Fig. 1 is a block diagram of a first embodiment rep- 
resenting the multiple picture/sound signals decoding 
apparatus of the present invention. This apparatus is ca- 
pable of decoding three independent moving picture sig- 
nals V1, V2, V3 and three independent sound signals 
A1 , A2, A3, and has two display modes, i.e., a multiple 
moving picture mode and a single moving picture mode. 
(For the purpose of avoiding complication of the dia- 
gram, the sound signal decoding circuit is shown sepa- 
rately in Fig. 6.) 

In the multiple moving picture mode, the moving pic- 
ture signals V1 , V2, V3 are so processed that each pic- 
ture is reduced to 1/2 both horizontally and vertically and 
is displayed in 1/4 divided area of one whole screen as 
illustrated in Fig. 3. In this diagram, the lower right area 
is blank. 

First a description will be given on the operation per- 
formed in the multiple moving picture mode. 

The multiplexed picture/sound code inputted via a 
terminal T5 to a buffer 1 01 is supplied to an inverse mul- 
tiplexer 1 02, where the input code is separated into mov- 
ing picture signals and sound signals. (As mentioned, 
the sound processing circuit is shown in Fig. 6 so as to 
avoid complication of the diagram.) The moving picture 
signals V1 , V2, V3 thus separated are supplied to de- 
coders 104, 106, 108 respectively. 

Fig. 2 shows the details of the decoder 104 (106, 
1 08). The input signal e received at a terminal T6 is sup- 
plied via a buffer 301 to an inverse multiplexer 302, 
where the motion vector data d is separated. Subse- 
quent processes executed sequentially in a variable 
length decoder 303, an inverse quantizer 304 and an 
inverse DCT 305 are exactly the same as those execut- 
ed in the aforementioned decoder shown in Fig. 20. The 
output of the inverse DCT 305 is branched into two, and 
one is supplied to a switch SW301 while the other to a 
reducer 306. 

In the reducer 306, the pixels are curtailed alter- 
nately in the horizontal and vertical directions so that the 
picture signal is reduced to 1 12 both horizontally and ver- 
tically. 

This process is illustrated in Fig. 21 where each cir- 
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cle denotes an jndividual pixel. The picture is reduced 
to 1/2 both horizontally and vertically by collecting the 
alternate pixels (denoted by hatched circles). 

The switch SW301 is controlled by a signal CNT1 
(n=1 in the decoder 104) obtained from the controller 
1 1 2 shown in Fig. 1 . In the multiple moving picture mode, 
the switch SW301 is connected to (m) so that the output 
of the reducer 306 is supplied to an adder 308. 

Meanwhile the motion vector data d separated in 
the inverse multiplexer 302 is branched and supplied to 
a divider 309. In accordance with reduction of the picture 
signal to 1/2 in the horizontal and vertical directions, the 
motion vector data d is also reduced to a 1/2 value in 
the divider 309. On the basis of the motion vector (X, Y) 
(where X stands for the horizontal component of the mo- 
tion vector and Y for the vertical component thereof), 
there is obtained a vector (X/2, Y/2) from the divider 309. 
Namely, the motion vector data is reduced in conformity 
with the reduction rate of the picture signal. 

A switch SW304 is controlled also by the signal 
CNT1 similarly to the aforementioned switch SW301 
and is connected to (m) in the multiple moving picture 
mode, whereby the output of the divider 309 is supplied 
to a predictive picture generator 307. A switch SW302 
is closed in the P and B frames, so that a predictive pic- 
ture outputted from the predictive picture generator 307 
is added by an adder 308 to the output of the switch 
SW301 . However, nothing is added to the I frame. 

The output of the adder 308 is supplied to a switch 
SW303. The connection of the switch SW303 is alter- 
nately changed to terminals XnW and YnW every time 
the I and P frames are decoded, and it is connected to 
a terminal ZnW at the time of the B frame. The terminals 
XnW, YnW, ZnW are connected respectively to the 
frame memories 109, 110, 111 shown in Fig. 1 , and the 
individual data of the three frames are stored in such 
memories respectively. (In Fig. 1 , XnR and XnW are de- 
noted by a single line Xn (R, W) for averting complication 
of the diagram.) Each of the frame memories 109, 110, 
1 1 1 is divided into four storage areas similarly to the dis- 
play screen, and the data are written in or read out from 
the divided storage spaces independently of one anoth- 
er. 

Figs. 4(a) to 4(c) show the storage spaces of the 
frame memories 109, 110, 111 in a manner that the pixel 
data stored in the memories coincide with the positions 
on the display screen. Figs. 4(a), 4(b) and 4(c) represent 
the contents of the X frame memory 1109, the Y frame 
memory 1110 and the Z frame memory 1111, respective- 
ly. 

If one frame is composed of horizontal m pixels by 
vertical n pixels as shown in Fig. 22, each pixel can be 
expressed as 

Fm [i, j] where 0^i<m,0^j<n 

In Fig. 4(a) for example, three kinds of pictures re- 
duced to 1/2 both horizontally and vertically are stored 
in the areas XV1 , XV2, XV3. The pixels in the individual 
pictures are expressed as 



XV1 [11, j1] where 0 ^ i1 < m/2, 0 ^ j1 < n/2 
XV2 [i2, j2] where 0 ^ i2 < m/2, 0 =i j2 < n/2 
XV3 [i3, j3] where 0 ^ i3 < m/2, 0 ^ j3 < n/2 
The following equations represent the positions in 
s the frame memories where the pixels of the individual 
pictures are practically written. 

Fm [M,j1] = XV1 [i1, j1] 



Fm [i2 + m/2, j2] = XV2 [i2, j2] 



Fm [S3, j3 + m/2] = XV3 [i3, j3] 

In the divided areas XV1 , XV2 and XV3, the picture 
data are written and read independently of one another 
in the same manner as in the individual different mem- 
ories. The same operation is performed in the other 
memory areas YV and ZV as well. As obvious from Figs. 
1, 2 and 4, the data inputted from the terminal X1W is 
written in the memory space XV1 and is read out there- 
from to the terminal X1 R. The operation is the same with 
respect to X2, X3, Y and Z as well. In accordance with 
the method for prediction of the P and B frames, the de- 
coded picture data obtained from the memories 1 09 and 
1 1 0 are supplied via the terminals X1 R, Y1 R to the pre- 
dictive picture generator 307, where a predictive picture 
is generated on the basis of the motion vector d and then 
is outputted to the switch SW302. (As mentioned, XnR 
and XnW are denoted by a single line Xn (R, W) in Fig. 
1 for averting complication of the diagram.) Similarly to 
the above example described with regard to the moving 
picture signal V1 , it is to be understood that the same 
process is executed relative to the moving picture sig- 
nals V2 and V3 independently of each other. With the 
exception that the picture signal is reduced to 1/2, the 
decoding process described above is the same as that 
executed in the decoder of Fig. 20. The decoded picture 
of the B frame obtained from the decoder 104 (106, 108) 
is written in the frame memory 111 . Meanwhile the de- 
coded pictures of the I and P frames to be displayed 
simultaneously with the B frame are read out from the 
frame memories 109, 110 and then are written in the 
frame memory 111. 

Now the timing of inputting the picture signals into 
the frame memory 111 will be described below. Fig. 10 
shows the sequence of allocation of the I, P and B 
frames relative to the input moving picture signals V1 , 
V2, V3 in the encoding apparatus of Fig. 16. Since the 
moving picture signals V1, V2, V3 are mutually inde- 
pendent, the sequence of the I, P, B frames is not exactly 
coincident therewith. However, a coincidence in the se- 
quence of the frames is preferable for the reason that 
the algorithm required for generating a predictive picture 
by dividing each frame memory can further be simpli- 
fied. 
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Figs. 1 1 to 13 show the decoding sequence and the 
storage sequence of the picture data in the frame mem- 
ories 109 and 110. The V1 decoding of Fig. 11 repre- 
sents the sequence of decoding the I.RB frames in the 
output signal of the adder 308 in Fig. 2. In Fig. 11, XV1 
and YV1 signify the sequence of storing the data of the 
I and P frames in XV1 of the frame memory 109 and 
YV1 of the frame memory 110, respectively. In Figs. 12 
and 13, V2 and V3 represent the same decoding se- 
quence. 

ZV1, ZV2, ZV3 in Fig. 14 signify the sequence of 
storing the data in ZV1 , ZV2, ZV3 of the frame memory 
111 respectively. 

In an exemplary case of inputting the frame No. 4, 
P4 is read out from XV1 and is written in ZV1 , and also 
14 is read out from XV3 and is written in ZV3. Meanwhile 
B4 obtained from the decoder 106 of Fig. 1 is loaded 
directly in ZV2 via the signal line Z2. 

As the frames of the same number are thus inputted 
into the frame memory 111, the frames are rearranged 
to resume the sequence shown in Fig. 10, i.e., the frame 
sequence of the original pictures prior to the encoding, 
and the rearranged data is outputted to an LPF 1 1 3 and 
a switch SW101 shown in Fig. 1. 

The above operation is controlled by control signals 
CNT (1 , 2, 3) and CNT (X, Y, Z) outputted from the con- 
troller 112. 

The LPF 113 is a low pass filter for eliminating the 
noise caused by the curtailment executed in the reducer 
306 shown in Fig. 2, and its operation is performed in 
both horizontal and vertical directions of the screen. The 
switch SW1 01 is connected to (m) in the multiple moving 
picture mode, and the output signal of the LPF 113 is 
supplied to a D-A converter 1 1 4 where digital-to-analog 
conversion is executed. The analog signal thus obtained 
is then supplied to a display device 115, where three 
reduced pictures are displayed as illustrated in Fig. 3. 
(Denoted by 1115 in Fig. 3 is a screen of the display 
device 115.) 

Hereinafter the operation in the single moving pic- 
ture mode will be described. 

Suppose now that the picture signal V1 is selected 
in the single moving picture mode. Then the switch 
SW301 incorporated in the decoder 1 04 is connected to 
(s) so that a nonreduced normal picture signal is decod- 
ed. Similarly the switch SW304 is connected also to (s), 
so that a nondivided former motion vector data d is in- 
putted to the predictive picture generator 307. 

The frame memories 109 and 110 are not divided 
differently from Fig. 4, and each serves as a single whole 
frame memory. Therefore, each frame memory func- 
tions in the same manner as in the decoder shown in 
Fig. 20. Namely, the frame memory 109 functions like 
the frame memory 67 in Fig. 20, and the frame memory 
110 like the frame memory 68, respectively. Meanwhile 
the frame memory 111 is functionally the same as the 
frame selection switch 70 in Fig. 20. The switch SW101 
is connected to (s), and the output signal from the frame 



memory 1 1 1 is supplied via the D-A converter 1 1 4 to the 
display device 115 without being passed through the 
LPF 113. 

On the screen of the display device 115, the picture 
s of the signal V1 is displayed in a normal size as illustrat- 
ed in Fig. 5. 

The actions of the switches and so forth executed 
in accordance with selective switchover of the operation 
modes is performed by the controller 112. The control 

10 signal (mode selection signal) used for controlling the 
switches and so forth may be selectively generated with 
depression of an external switching button or the like by 
a user to select a desired mode. It is also possible to 
preset the switching condition by the user in a manner 

is to switch the operation mode at a predetermined time 
interval of, e.g., 10 minutes or so. 

Fig. 6 shows an exemplary sound decoding appa- 
ratus. The sound signal A1 separated in an inverse mul- 
tiplexer 1 02 is inputted via a buffer 203 to a decoder 204 

20 and then is supplied to a selector 209. The other sound 
signals A2 and A3 are also processed in the same man- 
ner. In the multiple moving picture mode, the selector 
209 selects desired ones of the sound signals A1, A2, 
A3 in response to a control signal (mode selection sig- 

25 nal) obtained from a controller 1 1 2. Meanwhile in the sin- 
gle moving picture mode, the selector 209 selects the 
sound signal of the selected moving picture. The select- 
ed sound signal is supplied to a D-A converter 210 and 
then is reproduced by a reproducer which consists of an 

so amplifier 21 1 and a speaker 21 2. 

Hereinafter a second embodiment of the present in- 
vention will be described. When the signal decoding 
speed of the decoders 104, 106, 108 in Fig. 1 is suffi- 
ciently high, it is not necessary to provide a decoder for 

35 each channel, and multiple moving pictures can be de- 
coded by means of a single decoder through a time di- 
vision process. The detail of such second embodiment 
is shown in Fig. 7 (where X1W and X1R are denoted 
simply by X1 for averting complication of the diagram). 

40 As in the decoding apparatus of Fig. 1 , the input sig- 
nal from a terminal T7 is supplied via a buffer 401 , an 
inverse multiplexer 402 and a buffer 403 to a decoder 
404. This decoder 404 is the same in constitution as the 
aforementioned decoder shown in Fig. 2. Picture signals 

45 V1, V2, V3 decoded by the decoder 404 are time-divided 
and outputted sequentially from terminals X, Y, Z there- 
of. The output signals thus obtained are then delivered 
to a selector 405. The selector 405 is so constituted as 
shown in Fig. 8, where the connection to frame memo- 

so ries 406, 407, 408 is selectively changed in accordance 
with the decoded moving picture signals V1 , V2, V3 by 
a control signal s obtained from the decoder 404. For 
example, when the data is the moving picture signal V1 , 
XW is connected to X1 W, XR to X1 R, YW to Y1 W, YR 

55 to Y1 R, and ZW to Z1 W, respectively. 

The subsequent processes are exactly the same as 
those described with regard to the decoding apparatus 
of Fig. 1. In case the processing speed of the decoder 
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is sufficiently high, the constitution of Fig. 7 is also ca- 
pable of achieving the same function as that of Fig. 1 . 

The description given' hereinabove is concerned 
with an exemplary case of moving pictures of three 
channels. However, it is to be understood that the ap- 
paratus mentioned is capable of complying with moving 
pictures of any number of channels merely by changing 
the division of the frame memories and the reduction 
rate of the decoded pictures. 

For example, pictures reduced to 1/3 in the horizon- 
tal and vertical directions can be obtained by curtailing 
every third pixel in Fig. 21 instead of alternate pixels. 
And if the frame memory is equally divided into three 
both horizontally and vertically, a maximum of 9-channel 
pictures can be simultaneously decoded and displayed. 

Although the above description has been given with 
regard to an example of the MPEG system, the present 
invention is applicable also to any other picture com- 
pression system which performs motion prediction. 

In the multiple moving picture display mode, it is not 
exactly necessary to display the entire input moving pic- 
tures on the screen, and the user may select merely de- 
sired ones for display. 

In addition to the above example relative to the 
method of displaying multiple moving pictures simulta- 
neously by dividing the screen into multiple areas as il- 
lustrated in Fig. 3, there may be adopted another meth- 
od that uses multiple windows for displaying the pic- 
tures. According to such method, the individual pictures 
are displayed in respective windows, and any desired 
picture can be selected by employing functions of open- 
ing, closing, displacing, enlarging and reducing the win- 
dows. Fig. 9 shows a method of displaying multiple mov- 
ing pictures with such windows. 

As mentioned hereinabove, when multiple moving 
pictures are simultaneously reproduced in the multiple 
picture/sound signals decoding apparatus of the 
present invention, the moving picture signals are decod- 
ed with horizontal and vertical reduction, so that the re- 
quired frame memories need not be equal in number to 
the moving pictures, and merely one set of frame mem- 
ories are sufficient for decoding the signals. Since the 
display screen is divided for displaying multiple moving 
pictures, the provision of a single display means meets 
the requirement. Thus, it becomes possible to minimize 
the number of the frame memories and the display 
means to consequently diminish the constitution scale 
of the multiple picture/sound signals decoding appara- 
tus. 

Furthermore, either multiple moving pictures or a 
single one thereof can be selectively displayed due to 
switchover of the picture display modes. 



Claims 



out from a recording medium or those received via 
transmission lines, said apparatus comprising: 

decoding means (104,1 06, 108;404) for reduc- 
s ing the resolution of the input pictures signals 

to obtain a reduced display size thereof, 
frame memories (109,110,111,406,407,408) 
connected to said decoding means 
(104,1 06, 108;404) to store the reduced input 
10 picture signals, 

means (115;412) for displaying the reduced in- 
put picture signals adjacent to one another on 
a single screen; 

is characterized in that 

the decoding means (104,1 06, 108;404) com- 
prises means (302,309) for separating and re- 
ducing motion vectors in conformity with the re- 
20 duction rate of the picture signals, and means 

(307) for generating a predictive picture on the 
basis of the reduced picture signals and the re- 
duced motion vectors. 

25 2. The apparatus according to claim 1 , wherein control 
means (112;409) are provided for selecting, in re- 
sponse to a mode selection signal, a multiple mov- 
ing picture mode for displaying the reduced multiple 
moving pictures simultaneously on a single screen 

30 of said display means, or a single moving picture 
mode for displaying merely one of the multiple mov- 
ing pictures on the screen of said display means 
(115;412). 

35 3. The apparatus according to claim 2, wherein, when 
the selected display mode is a multiple moving pic- 
ture mode, said control means (112;409) divides 
said frame memories into multiple storage spaces 
and using such spaces independently of one anoth- 

40 er for generation of predictive pictures. 

4. The apparatus according to claim 2 or 3, wherein 
said mode selection signal is generated in response 
to a manipulation of an external means performed 

45 by a user for selecting a desired mode. 

5. The apparatus according to claim 2 or 3, wherein 
said mode selection signal is generated in conform- 
ity with the mode switching condition preset in ad- 

so vance. 

6. The apparatus according to claim 1 , wherein said 
display means (1 1 5;41 2) displays the multiple mov- 
ing pictures in multiple windows. 

55 



1. Apparatus for decoding input signals such as mul- 
tiple moving picture signals and sound signals read 
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Patentanepruche 

1. Vorrichtung zur Decodierung von Eingangssigna- 
len, wie zum Beispiel von Mehrfachenbewegtbildsi- 
gnalen und Mehrfachtonsignalen, welche von ei- 
nem Aufzeichnungsmedium ausgelesen worden 
sind oder welche uber Ubertragungsleitungen emp- 
fangen worden sind, wobei die Vorrichtung umfaBt: 

Decodierungsmittel (104, 106, 108; 404) zur 
Reduzierung der Aufldsung der Eingangsbild- 
signale, urn eine reduzierte AnzeigegroBe von 
diesen zu erhalten, 

Einzelbildspeicher (109, 110, 111, 406, 407, 
408), welche mit den Decodierungsmitteln 
(104, 106, 108; 404) verbunden sind, urn die 
reduzierten Eingangsbildsignale zu speichern, 

Mittel (115; 412) zur Anzeige der reduzierten 
einander benachbarten Eingangsbildsignale 
auf einem einzigen Bildschirm, 

dadurch gekennzeichnet, 

daB die Decodierungsmittel (104, 106, 108; 
404) Mittel (302, 309) zur Trennung und Redu- 
zierung von Bewegungsvektoren in Uberein- 
stimmung mit der Reduzierungsrate der Bildsi- 
gnale und Mittel (307) zur Erzeugung eines vor- 
hersagbaren Bildes auf der Basis der reduzier- 
ten Bildsignale und der reduzierten Bewe- 
gungsvektoren autweisen. 

2. Vorrichtung nach Anspruch 1 , bei welcher Steuer- 
mittel (112; 409) zur Auswahl eines Mehrfachbe- 
wegtbildmodus zur gleichzeitigen Anzeige der re- 
duzierten Mehrfachbewegtbilder auf einem einzi- 
gen Bildschirm der Anzeigemittel oder eines Ein- 
fachbewegtbildmodus zur Anzeige von lediglich ei- 
nem der Mehrfachbewegtbilder auf dem Bildschirm 
der Anzeigemittel (115; 412) als Reaktion auf ein 
Modus-Auswahlsignal vorgesehen sind. 

3. Vorrichtung nach Anspruch 2, bei welcher, wenn 
der ausgewahlte Anzeigemodus ein Mehrfachbe- 
wegtbildmodus ist, die Steuermittel (112; 409) die 
Einzelbildspeicher in Mehrfachspeicherplatze auf- 
teilen und derartige Platze unabhangig voneinan- 
derzur Erzeugung von vorhersagbaren Bildern ver- 
wenden. 

4. Vorrichtung nach Anspruch 2 oder 3, bei welcher 
das Modus-Auswahlsignal als Reaktion auf eine 
durch einen Anwender durchgefuhrte Manipulation 
einer externen Einrichtung zur Auswahl eines ge- 
wunschten Modus erzeugt wird. 



5. Vorrichtung nach Anspruch 2 oder 3, bei welcher 
das Modus-Auswahlsignal gemaB des Modus- 
Schaltzustands, welcher im voraus voreingestellt 
worden ist, erzeugt wird. 

5 

6. Vorrichtung nach Anspruch 1, bei welcher die An- 
zeigemittel (115; 412) die Mehrfachbewegtbilder in 
Mehrfachfenstern anzeigen. 

10 

Revendications 

1 . Appareil de d6codage de signaux d'entrSe tels que 
des signaux d'images mobiles multiples et des si- 
's gnaux de son multiples lus & partir d'un support d'in- 

formation d'enregistrement ou tels que ceux re$u 
via des lignes de transmission, ledit appareil 
comprenant : 

20 un moyen de d6codage (104, 106, 108 ; 404) 

pour r6duire la resolution de signaux d'image 
d'entr^e afin d'obtenir une dimension d'afficha- 
ge reduite afterente ; 

des mSmoires d'image (109, 110, 111, 406, 
25 407, 408) connect6es & I'aide dudit moyen de 

d6codage (104, 106, 108 ; 404) pour stocker 
les signaux d'image d'entr6e r6duits ; 
un moyen (115 ; 412) pour afficher les signaux 
d'image d'entr6e r6duits adjacents les uns aux 
30 autres sur un unique 6cran, 

caract6ris6 en ce que : 

le moyen de d6codage (104, 106, 108; 404) 
35 comprend un moyen (302, 309) pour sSparer 

et rSduire des vecteurs de d6placement en con- 
formity avec le taux de reduction des signaux 
d'image, et un moyen (307) pour g6n6rer une 
image de prediction sur la base des signaux 
40 d'image r£duits et des vecteurs de deplace- 

ment r6duits. 

2. Appareil selon la revendication 1 , dans lequel un 
moyen de commands (112; 409) est pr6vu pour s6- 

45 lectionner, en r6ponse k un signal de selection de 
mode, un mode images mobiles multiples pour af- 
ficher les images mobiles multiples r£duites simul- 
tan6ment sur un unique 6cran dudit moyen d'affi- 
chage ou un mode image mobile unique pour affi- 

so cher simplement Tune des images mobiles multi- 
ples sur l'6cran dudit moyen d'affichage (1 1 5 ; 41 2). 

3. Appareil selon la revendication 2, dans lequel, lors- 
que le mode d'affichage s6lectionn6 est un mode 

55 images mobiles multiples, ledit moyen de comman- 
de (112 ; 409) divise lesdites m6moires d'image se- 
lon de multiples espaces de stockage et utilise ces 
espaces ind6pendamment les uns des autres pour 
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la generation d'images de prediction. 

4. Appareit selon la revendication 2 ou 3, dans iequel 
ledit signal de selection de mode est g6n6r6 en r6- 
ponse k une manipulation d'un moyen externe ef- 5 
fectu6e par un utilisateur pour s6lectionner un mo- 
de souhaite. 

5. Appareil selon la revendication 2 ou 3, dans Iequel 
ledit signal de selection de mode est g6n6re en con- io 
formite avec la condition de commutation de mode 
pr66tablie & Pavance. 

6. Appareil selon la revendication 1 , dans Iequel ledit 
moyen d'affichage (115 ; 412) affiche les multiples is 
images mobiles dans de multiples fen§tres. 
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